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FREQUENCY DOMAIN POSTFILTERING FOR QUALITY 
ENHANCEMENT OF CODED SPEECH 



TECHNICAL FIELD 

This invention is related in general to the art of signal filtering for enhancing 
the quality of a signal, and more particularly to a method of postfiltering a 
synthesized speech signal to provide a speech signal of improved quality. 

BACKGROUND OF THE INVENTION 

Electronic signal generation is pervasive in all areas of electronic and electrical 
technology. When an electrical signal is used to emulate, transmit, or reproduce a 
real world quantity, the quality of the signal is important. For example, speech is 
often received via a microphone or other sound transducer and transformed into an 
electrical representation or signal. In addition to the artificial noise introduced as an 
artifact of this transformation, other artificial noise may be additionally introduced 
into the signal during transmission, and coding and/or decoding. Such noise is often 
audible to humans, and in fact may dominate a reproduced speech signal to the point 
of distracting or annoying the listener. 

Speech coders, particularly those operating at low bit rates, tend to introduce 
quantization noise that may be audible and thereby impair the quality of the recovered 
speech. A postfilter is generally used to mask noise in coded speech signals by 
enhancing the formants and fine structure of such signals. Typically, noise in strong 
formant regions of a signal is inaudible, whereas noise in valley regions between two 
adjacent formants of a signal is perceptible since the signal to noise ratio (SNR) in 



valley regions is low. The SNR in the valley region may be even lower in the context 
of a low bit rate codec, since the prevailing linear prediction (LP) modeling methods 
represent the peaks more accurately than the valleys, and the available bits are 
insufficient to adequately represent the signal in the valleys. Thus, it is desirable that 
a speech postfilter attenuates the valleys while preserving the peaks in order to reduce 
the audible noise level. 

Juin-Hwey Chen et al. have proposed an adaptive postfiltering algorithm 
consisting of a pole-zero long-term postfilter cascaded with a short-term postfilter. 
The short-term postfilter is derived from the parameters of the LP model in such a 
way that it attenuates the noise in the spectrum valleys. These parameters are 
commonly referred to as linear predictive coding coefficients, or LPC coefficients, or 
LPC parameters. Additionally, Wang et al. introduced a frequency domain adaptive 
postfiltering algorithm to suppress noise in spectrum valleys. The aforementioned 
postfiltering algorithms reduce noise without introducing substantial spectral 
distortion, but they are not efficient in reducing the perceptible noise in shallow, 
rather than deep, valleys between formants, especially in the context of low bit-rate 
coders such as those operating at below 8 kbps. A primary explanation for this 
drawback is that the frequency response of the postfilter itself does not adequately 
follow the detailed fine structure of the spectral envelope, leading to the masking of 
shallow valleys between closely-spaced formants. 

A typical early time domain LPC postfiltering architecture is illustrated in 
FIG.l. An input bit-stream, perhaps transmitted from an encoder, is received at 
decoder 100. A bit-stream decoder 1 10 associated with decoder 100 decodes the 



incoming bit-stream. This step yields a separation of the bit stream into its logical 
components or virtual channel contents. For example, the bit stream decoder 110 
separates LPC coefficients from a coded excitation signal for linear prediction-based 
codecs. The decoded LPC coefficients are transmitted to a formant filter 131, which 
is the first stage of a time domain postfilter 130. A synthesized speech signal 
produced by a speech synthesizer 120 is input to the formant filter 131 followed by a 
pitch filter 132 wherein the harmonic pitch structure of the signal is enhanced. 
Cascaded with the pitch filter, a tilt compensation module 133 is generally provided 
for removing the background tilt of the formant filter to avoid undesirable distortion 
of the postfilter. Finally, a gain control is applied to the signal in gain controller 134 
to eliminate discontinuity of signal power in adjacent frames. 

The frequency response of the postfilter architecture represented in prior 
speech postfiltering systems does not adequately follow the detailed fine structure of 
the speech spectrum nor does it always adequately resolve the spectral envelope peaks 
and valleys. 

SUMMARY OF THE INVENTION 

This invention provides a method of postfiltering in the frequency domain, 
wherein the postfilter is derived from the LPC spectrum. Furthermore, for enhancing 
the spectral structure efficiently, a non-linear transformation of the LPC spectrum is 
applied to derive the postfilter. To avoid uneven spectral distension due to a 
nonlinear transformation of the background spectral tilt, tilt calculation and 
compensation is preferably conducted prior to application of the formant postfilter. 



Finally, to avoid aliasing, the invention provides an anti-aliasing procedure in the time 
domain. Initial implementation results have shown that this method significantly 
improves the signal quality, especially for those portions of the signal attributable to 
low power regions of the speech spectrum. 

In general, signal filtering of speech and other signals may be performed in the 
time domain or the frequency domain. In the time domain, filter application is 
equivalent to performing a convolution combining a vector representative of the 
signal and a vector representative of an impulse response of the filter respectively, to 
produce a third vector corresponding to the filtered signal. In contrast, in the 
frequency domain, the operation of applying a filter to a signal is equivalent to simple 
multiplication of the spectrum of the signal by that of the filter. Thus, if the spectrum 
of the filter preserves the spectrum of the signal in detail, filtering of the signal 
preserves the fine structure and formants of the signal. In particular, a valley present 
in the speech spectrum will never completely disappear from the filtered spectrum, 
nor will it be transformed into a local peak instead of a valley. This is because the 
nature of the inventive postfilter preserves the ordering of the points in the spectrum; 
a spectral point that is greater than its neighbor in the pre-filter spectrum will remain 
greater in the filtered spectrum, although the degree of difference between the two 
may vary due to the filter. 

Thus, the postfilter described herein employs a frequency response that 
follows the peaks and valleys of the spectral envelope of the signal without producing 
overall spectrum tilt. Such a postfilter may be advantageously employed in a variety 
of technical contexts, including cell phone transmission and reception technology, 



Internet media technology, and other storage or transmission contexts involving low 
bit-rate codecs. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.l is a schematic view showing a typical prior art time domain- 
postfiltering architecture; 

FIG.2 is an architectural diagram of network linked codecs; 

FIG3 is a simplified structural schematic of a frequency domain postfilter 
according to an embodiment of the invention; 

FIGs.4a ? 4b and 4c are structural schematics illustrating components of a 
frequency domain formant filter according to an embodiment of the invention; 

FIGs.Sa and 5b are structural schematics illustrating components of a 
frequency domain formant filter according to an alternative embodiment of the 
invention; 

FIGs.6a and 6b are flow charts demonstrating steps executed in performing 
postfiltering according to an embodiment of the invention; and 

FIG.7 is a simplified schematic illustrating a computing device architecture 
employed by a computing device upon which an embodiment of the invention may be 
executed. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention is generally directed to a method and system of 
performing postfiltering for improving speech quality, in which a postfilter is derived 
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from a non-linear transformation of a set of LPC coefficients in the frequency 
domain. The derived postfilter is applied by multiplying the synthesized speech 
signal by formant filter gains in the frequency domain. In one embodiment, the 
invention is implemented in a decoder for postfiltering a synthesized speech signal. 
According to alternate embodiments of the invention, the LPC coefficients used for 
deriving the postfilter may be transmitted from an encoder or may be independently 
derived from the synthesized speech in the decoder. 

Although it is not required, the present invention may be implemented using 
instructions, such as program modules, that are executed by a computer. Generally, 
program modules include routines, objects, components, data structures and the like 
that perform particular tasks or implement particular abstract data types. The term 
"program" includes one or more program modules. 

The invention may be implemented on a variety of types of machines, 
including cell phones, personal computers (PCs), hand-held devices, multi-processor 
systems, microprocessor-based programmable consumer electronics, network PCs, 
minicomputers, mainframe computers and the like. The invention may also be 
employed in a distributed system, where tasks are performed by components that are 
linked through a communications network. In a distributed system, cooperating 
modules may be situated in both local and remote locations. 

An exemplary telephony system in which an embodiment of the invention may 
be used is described with reference to FIG.2. The telephony system comprises codecs 
200, 220 communicating with one another over a network 210, represented by a 
cloud. Network 210 may include many well-known components, such as routers, 



gateways, hubs, etc. and may allow the codecs 200 to communicate via wired and/or 
wireless media. Each codec 200, 220 in general comprises an encoder 201, a decoder 
202andapostfilter 203. 

Codecs 200 and 220 preferably also contain or are associated with a 
communication connection that allows the hosting device to communicate with other 
devices. A communication connection is an example of a communication medium. 
Communication media typically embody computer readable instructions, data 
structures, program modules or other data in a modulated data signal such as a carrier 
wave or other transport mechanism and include any information delivery media. The 
term computer readable media as used herein includes both storage media and 
communication media. The codec elements described herein may reside entirely in a 
computer readable medium. Codecs 200 and 220 may also be associated with input 
and output devices such as will be discussed in general later in this specification. 

Referring to FIG.3, an exemplary postfilter 303 on which the system described 
herein may be implemented is shown. In its most basic configuration, the postfilter 

303 utilizes an input synthesized speech signal S(n) and LPC coefficients a, in 
conjunction with a frequency domain formant filter 310. The postfilter may also have 
additional features or functionality. For example, a pitch filter 320 and a gain 
controller 330 are preferably also implemented and utilized as will be described 
hereinafter. 

It is known that the encoding and decoding of a speech signal typically will 
introduce unwanted noise into the signal. In the signal frequency spectrum, such 
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noise overlaps the speech signal and is particularly audible to humans in valley 
regions between consecutive formants. A properly designed and implemented 
postfilter will aid in removing this unwanted noise. An ideal postfilter is one that has 
a frequency response that follows the frequency spectrum of the signal of interest. 
5 Most current codecs are based on the principle of linear prediction, wherein the 

coefficients of the linear prediction follow the signal frequency spectrum. In addition 
to other innovative procedures to be discussed, the invention takes advantage of this 
relationship to derive a speech postfilter, although the invention also allows for the 
independent generation of LPC parameters. 
2 1 0 There are a wide variety of ways in which frequency domain postfiltering may 

# be performed in accordance with the invention. According to one embodiment, 

2 frequency domain postfiltering is performed sequentially within the postfilter. 

w Referring to FIG.4a, the frequency domain formant filter 410 comprises a Fourier 

J transformation module 4 1 1 , a formant filtering module 4 1 2 and an inverse Fourier 

1 5 transformation module 413. The Fourier transformation and the inverse Fourier 
^ transformation modules are available to the formant filtering module 412 to transfer 

signals between the time domain and the frequency domain, as will be appreciated by 
those of skill in the art. The Fourier and inverse Fourier transformations of the 
transformation modules 41 1 and 413 are preferably executed according to the 
20 standard Discrete Fourier Transformation (DFT). 

The formant filtering module 412 generates frequency domain gains and filters 
the input synthesized speech signal by applying the generated gains before 
transforming the subject signal back to the time domain. FIG.4b further illustrates the 
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components of the formant filtering module 412, which comprises a LPC tilt 
computation module 415, a LPC tilt compensation module 420, a gain computation 
module 430 and a gain application module 440. The operation of these modules is 
described in greater detail below with respect to Fig.6, but will be described here 
5 briefly as well. 

In general, an encoded LPC spectrum has a tilted background. This tilt may 
result in unacceptable signal distortion if used to compute the postfilter without tilt 
compensation. In particular, this tilted background could be undesirably amplified 
during postfiltering when the postfilter involves a non-linear transformation as in the 
IS 1 0 present invention. Application of such a transformation to a tilted spectrum would 
y3 have the effect of nonlinearly transforming the tilt as well, making it more difficult to 

§3 later obtain a properly non-tilted spectrum. Thus it is preferable to remove the 

ys 

1 ¥ background tilt of the spectrum prior to the nonlinear transformation. According to 

5 the invention, the tilt compensation module 420 properly removes the tilted 

™= 3 
? =...5 

C s 1 5 background according to the tilt estimated by the LPC spectrum tilt computation 
^ module 415. 

The gain computation module 430 calculates the frequency domain formant 
filter gains including magnitude and phase response. At this point, the gain 
application module 440 applies the gains multiplicatively to the speech signal in the 
20 frequency domain. 

Referring to FIG.4c, the gain computation module comprises a time domain 
LPC representation module 431, a modeling module 432, a LPC non-linear 
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transformation module 433, a phase computation module 434, a gain combination 
module 435, and an anti-aliasing module 436. 

LPC representation module 43 1 creates a time domain vector representation of 
the LPC spectrum, after which the vector is transformed into the frequency domain 
for further processing. The modeling module 432 models the frequency domain 
vector based on one of a number of suitable models known to those of skill in the art. 
In an embodiment of the invention, the inverse of the LPC spectrum is used to 
calculate the gains. 

The LPC non-linear transformation module 433 calculates the magnitude of 
the formant filter gains by conducting a non-linear transformation of the magnitude of 
the inverse LPC spectrum. According to one embodiment of the invention, a scaling 
function with a scaling factor of between 0 and 1 is used as a non-linear 
transformation function, as will be described in greater detail below. The parameters 
in the scaling function are adjustable according to dynamic environments, for 
example, according to the type of input speech signal and the encoding rate. The 
phase computation module 434 calculates the phase response for the formant filter 
gains. According to one embodiment, the phase computation module 434 calculates 
the phase response via the Hilbert transform, in particular, the phase shifter. Other 
phase calculators, for example the Cotangent transform implementation of the Hilbert 
transform may alternatively be used. . Using the magnitude and the phase of the 
formant filter gains provided by the LPC non-linear transformation module 433 and 
the phase computation module 434, the gain combination module 435 generates the 
gains in the frequency domain. An anti-aliasing module 436 is preferably provided to 
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avoid aliasing when postfiltering the signal. It is preferred, but not essential, to 
conduct the anti-aliasing operation in the time domain. 

According to the invention, the frequency domain postfilter is derived from the 
LPC spectrum and generates, for example, the frequency domain formant gains, 
wherein the derivation involves a sequence of mathematic procedures. It may be 
desirable to provide a separate calculation unit that is responsible for all or a portion 
of the mathematical processing. In another embodiment of the invention, a separate 
LPC evaluation unit is provided to derive the LPC coefficients as shown in FIG. 5. 

Referring to FIG.5, the frequency domain formant filter 500 comprises a 
Fourier transformation module 51 1, an inverse Fourier transformation module 5 13, a 
gain application module 540 and a LPC evaluation unit 521. The Fourier 
transformation module 51 1, inverse Fourier transformation module 513 and the gain 
application module 540 may be the same as the modules referred to by similar 
numbers in FIG.4. According to the invention, the LPC evaluation unit 521 
comprises a LPC tilt computation module 510, a LPC tilt compensation module 520 
and a gain computation module 530, wherein these components may be same as the 
components referenced by the similar numbers in FIG.4. 

In operation, the alternative embodiment described in Fig.5 varies slightly 
from the embodiment illustrated by way of Fig.4. In particular, the gain application 
module 540 receives as input a synthesized speech signal and provides as output a 
filtered synthesized speech signal. Fourier and inverse Fourier transform modules 
511 and 513 are available to the gain application module for transformation of the 
pre-filtered speech signal into the frequency domain, and for transformation of the 
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post-filtered speech signal into the time domain. LPC evaluation unit 521 receives or 
calculates the LPC coefficients, accesses the transformation modules 5 1 1 and 513 
when necessary for transformation between the time and frequency domains, and 
returns computed gains to the gain application module 540. 
5 Referring to FIG.6a and 6b, exemplary steps taken to perform postfiltering in 

accordance with an embodiment of the invention are illustrated. The synthesized 

speech signal S(n) and the LPC coefficients a, are received at step 601. Because an 
encoded LPC spectrum generally has a tilted background that induces extra distortion 
when used directly to compute formant postfilter, it is preferable to first compute and 
J 10 correct for any spectral tilt. Uncorrected tilt may be undesirably amplified during the 
m computation of the postfilter, especially when such computation involves a non-linear 

On transformation. Accordingly, at steps 603 and 605, respectively, the LPC spectrum 

L tilt is calculated and the spectrum compensated therefor. Exemplary mathematic 

Si procedures usable to execute these steps are as follows. Those of skill in the art will 

q 1 5 recognize that the following mathematical procedures may be modified in 

arrangement and detail and yet achieve the same result. For LPC coefficients a,- 
(i=0J..P and a 0 =l\ where P is the order of the LPC polynomial coefficients, the tilt 
\x of the LPC spectrum is defined as: 

*(0) 

20 where R(l) and R(0) are autocorrelation values of the LPC parameters defined 

by 
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/=/>-! 



*(t)= 5>,a m x=0,l 



(=0 



The LPC order P is selected depending on the sample frequency as will be apparent to 
those of skill in the art. In this embodiment, P=10 is used for MHz and 1 1 .025kHz 
sampling rates, while P=16 is used for 16kHz and 22.05kHz sampling rates. Given 
5 the calculated tilt u, the LPC coefficients a, are compensated as follows: 



a. = < 



a 0 i = 0 

a, -0.7ua,_! i = \,..p 
-0.1\x,a p i = p + \ 



At step 607, a vector representation denoted by A of the tilt compensated LPC a, in 
the time domain is obtained by zero-padding to form a convenient size vector. An 
exemplary length for such a vector is 128, although other similar or quite different 

10 vector lengths may equivalently be employed. 

At steps 609 to 623 the formant postfilter gains including magnitude and phase 
response are calculated. In particular, at step 609, the vector A is transformed to a 
frequency domain vector A '(k) via a Fourier transformation. At step 613, the 
frequency domain vector A '(h) is modified by inversing the magnitude of the A '(k) 

1 5 and converting to log scale (dB). The transfer function according to this step is 
denoted by H(k). For mathematical efficiency and convenience, H(k) is first 

A 

normalized in step 615 to H(k) , as in the following example: 

ff_(*)-ff~.(*> 
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y 5 

H 5 



where H max (k) and represent the maximum and the minimum values of H(k), 

respectively. 

In step 615, the normalized function H(k) is non-linearly transformed through 
a scaling function such as the following: 



T(k) = g 



H(k) 



= lnlQ /zj _ZJ \ 
S \ max mm / 

20c 



where c is a constant. An exemplary value of c is 1 .47 for a voiced signal, and 1.3 for 
an unvoiced signal The scaling factor y may be adjusted according to dynamic 
environmental conditions. For example, different types of speech coders and 
encoding rates may optimally use different values for this constant. An exemplary 
If 10 value for the scaling factor y is 0.25, although other scaling factors may yield 

acceptable or better results. Even though the present invention has been described as 
utilizing the above scaling function for the step of non-linear transformation, other 
non-linear transformation functions may alternatively be used. Such functions 
include suitable exponential functions and polynomial functions. 
15 The function T(k) obtained in step 615 is then used to estimate the phase 

response of the gain. In accordance with the invention, steps 617 to 623 implement 
the Hilbert phase shifter to calculate the phase response Q(k) of the gain. In particular, 
at step 617, the function T(k) is transferred into the time domain by conducting the 
Fourier transformation, since the Hilbert phase shifter is conducted in the time 
20 domain. At step 619, The phase response Q(n) is obtained by multiplying T(n) with j, 
wherein j is defined as j 2 = -1. At step 621, the calculated phase response of the gains 
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Q(n) are transformed into the frequency domain phase response Q(k) for further 
processing in the frequency domain. 

At step 623, the frequency domain formant filter gain F(k) is obtained by 
combining the magnitude and phase components as follows: 

-T(k) 

F(k) = L(k)e Mk \ L{k) = 10* 
where q and g are constants defined as: 

" ? o r^r\ ^ max XM mm / 

20c 20c 
wherein In is the natural logarithm. 

Steps 625 to 631 are executed to conduct anti-aliasing in the time domain. In 
particular, in step 625, the frequency domain gain F(k) is transformed to a time 
domain gain f(n) through execution of an inverse Fourier transformation. That is, the 
Inverse Fourier transformation of F(k) equals/f)^. In step 627, a second function g(n) 
is defined by zeroing the coefficients of f(n) according to the Fourier transformation 
length TV and the input speech segment length Mas follows: 

( \f{n) n = 0X..N-M 
5 [0 n> N-M 

Step 629 entails applying a standard normalization procedure to g(n) as follows: 



gQ0 

In-m 
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Finally, the frequency domain gain G(k) after anti-aliasing is obtained by transferring 
the time domain function g n (w) into the frequency domain through a Fourier 
transformation in step 631. That is, the Fourier transformation of g yi {n) equals G(k). 
Having calculated the frequency domain formant gain G(k), steps 633 to 637 

are executed to effect filtering of the input synthesized speech signal S(n) . In 

particular, in step 633, the signal S(n) is first transferred into a frequency domain 

A 

signal S(k) . Recalling that postfiltering in the frequency domain is implemented by 

A 

multiplication of the signal by a gain for each frequency, S(k) is multiplied in step 
635 by the frequency domain formant filter gains G(k) and the postfiltered speech 

A A 

signal S\k) is then obtained. By then transforming 5" (k) into the time domain in 

step 637, a postfiltered speech signal S'(ri) is obtained. 

With reference to Figure 7, one exemplary system for implementing 
embodiments of the invention includes a computing device, such as computing device 
700. In its most basic configuration, computing device 700 typically includes at least 
one processing unit 702 and memory 704. Depending on the exact configuration and 
type of computing device, memory 704 may be volatile (such as RAM), non-volatile 
(such as ROM, flash memory, etc.) or some combination of the two. This most basic 
configuration is illustrated in Fig.7 by line 706. Additionally, device 700 may also 
have additional features/functionality. For example, device 700 may also include 
additional storage (removable and/or non-removable) including, but not limited to, 
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magnetic or optical disks or tape. Such additional storage is illustrated in Fig.7 by 
removable storage 708 and non-removable storage 710. Computer storage media 
includes volatile and nonvolatile, removable and non-removable media implemented 
in any method or technology for storage of information such as computer readable 
5 instructions, data structures, program modules or other data. Memory 704, removable 
storage 708 and non-removable storage 710 are all examples of computer storage 
media. Computer storage media includes, but is not limited to, RAM, ROM, 
EEPROM, flash memory or other memory technology, CDROM, digital versatile 
disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic 
10 disk storage or other magnetic storage devices, or any other medium which can be 

ypj used to store the desired information and which can be accessed by device 700. Any 

S such computer storage media may be part of device 700. 

* u Device 700 may also contain one or more communications connections 712 

m that allow the device to communicate with other devices. Communications 

yg 1 5 connections 7 1 2 are an example of communication media. Communication media 
^ typically embodies computer readable instructions, data structures, program modules 

or other data in a modulated data signal such as a carrier wave or other transport 
mechanism and includes any information delivery media. The term "modulated data 
signal" means a signal that has one or more of its characteristics set or changed in 
20 such a manner as to encode information in the signal. By way of example, and not 
limitation, communication media includes wired media such as a wired network or 
direct- wired connection, and wireless media such as acoustic, RF, infrared and other 
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wireless media. As discussed above, the term computer readable media as used 
herein includes both storage media and communication media. 

Device 700 may also have one or more input devices 714 such as keyboard, 
mouse, pen, voice input device, touch input device, etc. One or more output devices 
716 such as a display, speakers, printer, etc. may also be included. All these devices 
are well known in the art and need not be discussed at greater length here. 

It will be appreciated by those of skill in the art that a new and useful method 
and system of performing postfiltering have been described herein. In view of the 
many possible embodiments to which the principles of this invention may be applied, 
however, it should be recognized that the embodiments described herein with respect 
to the drawing figures are meant to be illustrative only and should not be taken as 
limiting the scope of invention. For example, those of skill in the art will recognize 
that the illustrated embodiments can be modified in arrangement and detail without 
departing from the spirit of the invention. For example, the invention is described as 
employing a scaling function with the scaling factor being between 0 and 1 for non- 
linear transformation. However, other transformation functions and factors may also 
be employed. For example, exponential and polynomial functions may also be used 
within the invention. Further, although the Hilbert phase shifter is specified for 
calculating the phase response of the gain, other techniques for calculating the phase 
response of a function may also be used, such as the Cotangent transform technique. 
In conducting time domain to frequency domain transformation, this specification 
prescribes the DFT, but other transformation techniques may equivalently be 
employed, such as the Fast Fourier Transformation (FFT), or even a standard Fourier 



19 

transformation. Although the invention is described in terms of software modules or 
components, those skilled in the art will recognize that such may be equivalently 
replaced by hardware components. Therefore, the invention as described herein 
contemplates all such embodiments as may come within the scope of the following 
claims and equivalents thereof. 



